We introduce Aligner, a novel Parameter-Efficient Fine-Tuning (PEFT) method for aligning multi-billion-parameter-sized Large Language Models (LLMs). Aligner employs a unique design that constructs a globally shared set of tunable tokens that modify the attention of every layer. Remarkably with this method, even when using one token accounting for a mere 5,000 parameters, Aligner can still perform comparably well to state-of-the-art LLM adaptation methods like LoRA that require millions of parameters. This capacity is substantiated in both instruction following and value alignment tasks. Besides the multiple order-of-magnitude improvement in parameter efficiency, the insight Aligner provides into the internal mechanisms of LLMs is also valuable. The architectural features and efficacy of our method, in addition to our experiments demonstrate that an LLM separates its internal handling of "form" and "knowledge" in a somewhat orthogonal manner. This finding promises to motivate new research into LLM mechanism understanding and value alignment.

When Artificial Intelligence (AI) technologies began to make significant advances around two decades ago, societies began to talk more earnestly about both its possibilities and dangers. Now, with the rise of Generative AI (GAI) and tools like ChatGPT and DALL-E 2, AI is starting to enter mainstream industry and society. AI is about to become a disruptive, revolutionary technology. Things are about to get very interesting. Why and what does this mean.

Artificial Intelligence (AI) is arguably the most revolutionary technology that is seen in several decades having the potential to completely turn the world upside down and then re-shape it with new contours. In the coming years, we will continue to witness the disruption what deep learning and AI-related technologies can bring to create an impact not only to the software and the internet industry but also to other verticals such as manufacturing, automobile, agriculture, and healthcare and so on. AI will reinvent everything from the nature of work to the way we communicate. The disruptive destruction unleashed by AI would make a turbulent impact on the current skills making jobs redundant while opening avenues for new skills. With the rise of AI-enabled chips, convergence of IoT and AI at the edge, and interoperability among neural networks, automated machine learning will gain prominence.

Over the next 25 years, a revolutionary technology will transform our world. It will save us money, boost production of goods fivefold, and make our lives more comfortable. But it will crater wages by 90%, drive whole swaths of skilled workers to starvation, destroy families, and cause wide-scale political and social upheaval, sparking mobs, riots, and armed rebellion. The invention: The Jacquard loom. The Jacquard loom is a wooden contraption that fits to the head of a regular loom. You feed it punch cards, and it controls the weaving patterns for you.

Washington, D.C. – David Kenny, IBM Senior Vice President for Watson and Cloud, today sent a letter to all members of Congress outlining the company's point of view on policy matters tied to the emergence of artificial intelligence. The letter previewed remarks that Kenny will make before an inaugural briefing to the newly-formed House of Representatives Artificial Intelligence Caucus. Artificial Intelligence is reshaping our world. It is an exciting time, but one that prompts necessary questions. I am encouraged that leaders in Congress have recognized the power of this technology by convening an Artificial Intelligence Caucus, led by Congressman John Delaney (MD-06), and Congressman Pete Olson (TX-22).

Science & technology has leaped forward very fast in the 20th century. Innovators invented radio tuners and circuits and first robot in 1921. Now, immersive digital world connects people across the world, artificial organs have been created for our bodies and even self-driven cars has been rolled out. And we are still speeding towards new innovations and creativity every day. This will take the burden off the IT.

Artificial intelligence has the opportunity to affect almost every aspect of how we live and consume. I struggle to think of a single industry that could not be transformed through AI technologies, leading to huge gains in effectiveness or efficiency. Yet it's sometimes hard to see a place for AI in particular businesses or organizations, especially if there's an established product, workflow, and way of thinking. Because of this, it can be easy to overlook the opportunities afforded by some of the most revolutionary technologies of our age. To see these opportunities, it is important to remember that powerful AI methods have not been around for very long.